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I. INTRODUCTION 

Statistical mechanics away from thermal equilibrium 
and detailed balance is an important field of modern the- 
oretical physics with many open problems, one of them 
being a systematic characterization of heat processes con- 
necting nonequilibrium steady states. In this paper we 
focus on one specific step therein, namely the problem 
of how to naturally extend the concept of heat capacity 
to steady nonequilibrium systems. A specific proposal 
motivated by previous work on macroscopic frequency- 
dependent calorimetry [J-Q , and reformulated within the 
framework of nonequilibrium stochastic processes, has 
been given in Q based on the concept of quasistatic ex- 
cess heat [1, @ . 

As it has been observed in Q, the steady heat capac- 
ity exhibits some new features with no direct equilib- 
rium analogy, including the possibility that it becomes 
negative far from thermal equilibrium. In this paper 
we continue the study by analyzing two simple discrete 
models which can be considered as paradigms: (1) a 
stochastic two-level model with multiple transition chan- 
nels and (2) a three-level model. Both are maintained 
under nonequilibrium conditions via the presence of non- 
potential forces. We analyze their thermal properties in 
various temperature and driving regions, and we pro- 
pose an interpretation of the obtained results in terms 
of "renormalized" (thermo)dynamic quantities. We pay 
special attention to a "gauge" invariance that is inher- 
ently present in systems with non-potential forces and 
we also indicate how it can be used in a constructive 
way. 

The paper is organized as follows. In the next sec- 
tion we review the formalism of discrete Markovian pro- 
cesses that can describe nonequilibrium systems and we 
discuss their gauge invariance. We also introduce the 
two nonequilibrium models mentioned above, and ana- 
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lyze their basic steady properties. In section [HI] we ex- 
plain the concept of excess heat in the quasistatic limit. 
Our main results for the two models are given in Sec- 
tion IIVI and we conclude with a summary and outlook 
towards further research work, section [V] 

II. MODEL NONEQUILIBRIUM SYSTEMS 

We consider stochastic systems with discrete states 
representing distinct configurations of some mesoscopic 
system that exchanges energy with its surroundings in 
the forms of work and dissipated heat. As a slight gener- 
alization with respect to jj], we allow for multiple tran- 
sition channels i A j connecting any two states i and 
j along a channel b. Each transition channel is associ- 
ated with the amount of heat q\^ = —qj_^ dissipated 
into an attached reservoir. Typically, the heat quanta 
are introduced via the energy balance along the transi- 
tions, with some a priori given energy levels Si of the 
states together with the amount of work done on 

the system by other forces whose effect is not included 
in the energy level differences. The energy balance along 

any single transition i — >■ j is 

£j -Si = w^j - q^j (1) 

A general stochastic trajectory uj consists of a sequence 
of such transitions, and the global balance equation then 

reads £ fin - e in i = Y/ w i^j - E 9i4,'i with 12^ 
running over all transitions along lu. Here we assume the 
system's environment to consist of a single heat bath so 
that the total dissipated heat Q(ui) = Qi-*j equals 

the energy increase in the bath which can in principle be 
measured by calorimetric techniques. 

We assume here a typical scenario of nonequilibrium 
stochastic thermodynamics in which the system is driven 
out of equilibrium by the presence of non-conservative 
forces Since such forces do not derive from a po- 
tential, their work cannot be completely included in the 
energy level differences and W(uj) = w i^j depends 
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on the entire trajectory uj rather than on the initial and 
final states only. In this way the energy balance equa- 
tion (Q} gives the heat in terms of the work of potential 
and non-potential forces, respectively. In applications 
there is often a natural way to make such a decomposi- 
tion so that both potential and non-potential components 
can be accessed separately. Yet, this decomposition is in- 
trinsically non-unique: the "gauge" transformation 




£0 = 



FIG. 1: Two-level model with two transition channels. The 
work performed along the counterclockwise cycle equals 2F. 
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with an arbitrary ip leaves the dissipation functions q\^j 
invariant, and this can sometimes be used to simplify 
the description of a model. The simplest example is a 
close-to-equilibrium regime with the gauge fixed so that 
the non-potential forces (or the corresponding work func- 
tions) become manifestly small, and can hence be dealt 
with as perturbations around a reference equilibrium. 

Later we will show how to employ the gauge invariance 
even in some far-from-equilibrium regimes. The idea is 
to adapt the gauge to a certain dynamical potential that 
naturally appears in the context of quasistatic energy 
exchange, and which itself is gauge- invariant though gen- 
erally temperature-dependent. Loosely speaking, those 
regimes where the temperature-dependence becomes 
weak allow for the construction of "almost well-defined" 
energy levels. 



We assume the dynamics of our models to be Marko- 
vian, with fcjL^- the transition rates that are related to 
the heat functions q£ ■ by the local detailed balance prin- 



ciple 
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where T is the reservoir temperature. Obviously, in the 
absence of non-potential forces (or, in terms of the gauge 
transformation ([2"]). if the work contribution to the bal- 
ance (JT|) can be completely transformed out such that 
u>^j = 0), the above condition boils down to the usual 
detailed balance, = fcf_^ exp[(ii — £j)/(fcgT)]. This 
equation describes equilibrium dynamics with Boltzmann 
steady distribution. However, the presence of non- 
potential forces makes the dynamical properties funda- 
mentally different from thermal equilibrium. The steady 
state is generally specified by the stationary occupations 
Pi and the stationary currents Jf_^j = Pik^j — pjkj^, 
obtained by solving the stationary master equation 







(4) 



with the sum over all target configurations j and all tran- 
sition channels b connecting both ends. The amount of 
steady dissipation is given by the total stationary heat 



current into the reservoir, i.e. from all transition chan- 
nels added together: 



i, j, b 
i,3, b 



(5) 



where the second expression follows by combining with 
the balance (JXJ) and the stationary equations the fac- 
tor 1/2 being added to avoid double counting. 



A. Model I: Two-level system with biased channels 

As our first model we consider a system with two states 
'0' and '1' that are connected by two distinct channels 
'+' and ' — ', see Fig. [T] We assume that the states have 
the energies £o = and e± = U > 0, and that an ad- 
ditional driving force performing work w^_ ) _ 1 — ±F is 
applied. Hence, for the loop formed by the allowed tran- 
sitions we have W(0 1 — > 0) = 2F, manifesting a 
non-potential character of the driving force. From the 
heat functions q$_^i = ±F — U we immediately see that 
the case F > U (respectively — F > U) corresponds to a 
strong noncquilibrium regime in which the system dissi- 
pates a positive amount of energy along both transitions 

in the loop — » 1 — > (respectively its reversal). Note 
that in this regime the (original) notion of energy gap 
separating both states and uniquely distinguishing be- 
tween the ground and excited states becomes essentially 
meaningless. 

The most general transition rates compatible with the 
local detailed balance principle © arc 



= A exp 
kf^Q = A exp 



±F-U 
2k B T 

±F-U 
2k B T 



(6) 



with arbitrary parameters A and $, possibly depen- 
dent on the other system parameters F, U and T in 
a non-trivial way. While A only sets an overall time- 
scale and hence can be mostly ignored, the parameter $ 
measures the direction-independent asymmetry between 
both channels, i.e., their relative time-scales. In the se- 
quel we only assume that 4> can be kept constant when 
changing the temperature. This appears to be a rather 
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serious (and physically not well motivated) assumption, 
but we make it in order to simplify our presentation as 
well as to better separate the non-potential and the ad- 
ditional channel-asymmetry effects. For convenience, we 
set A = 1, ks = 1 and always assume $ > 0. (Note 
the symmetry of the dynamics under the channel-reversal 
combined with F M> —F and 4> h-> — $.) 

The stationary distribution satisfying (TJ| coincides 
with that of the channel-unresolved two-level system 



having the rates Aq- 



k+ 



k 



0->l 



and Ai_ 



fcJLj.Q + k 1 _ i0 , hence the relative occupations are 



Pi 
Po 



A - 



Ai- 



i + C 
i-C 



(7) 



with ( = tanh(^) tanh(^). The corresponding steady 
rate of dissipation ([5]) is q = 2FJ > with J = Jq_^ 1 = 
Ji_^ the stationary current, 



J = 



sinh(^) 



cosh(^) cosh(^r) [l — Ctanh(^y 



■)] 



(8) 



In formula (JT]) we see modifications with respect to the 
equilibrium Boltzmann statistics whenever $ ^ 0. It 
agrees with our intuition that relative throttling of the 
' — ' with respect to the '+' channel under a positive F > 
tends to increase the occupancy of the "excited" state 
'1'. Eventually in the limit $ — > +oo the '— ' channel 
completely closes and the system is again found at ther- 
mal equilibrium (J = 0) but now with the energy gap 
U — F. The resulting population inversion for F > U 
is a most simple example of gauge transformation, ap- 
plied here to easily deal with the driving forces when 
they become derivable from a potential. From this point 
of view, the population inversion is a superficial concept 
here since U — F = i\ — £o is just the full energy gap af- 
ter the transformation @ with %pi—ipo = ~F completely 
removing the driving force has been applied. 

However, more important is how these simple obser- 
vations carry over when both channels remain open to 
hold the system out of equilibrium: one checks that for 
an arbitrarily weak channel asymmetry the population 
inversion p\ > po still occurs whenever the driving force 
is strong enough, and for large enough (but finite) tem- 
peratures. This follows from 



log(^) 



£/-Ftanh(f) 
f 



O 



T 2 ) 



(9) 



In contrast to the limiting case $ — > +oo, the driving 
force now does not derive from a potential and hence 
cannot be transformed out. Nevertheless, the leading 
term in the high-temperature expansion (j9|) suggests that 
U — Ftanh(^) may take over the role of an effective 
energy gap, though we are now dealing with a genuine 
nonequilibrium system where the energy levels are am- 
biguously defined. This proposal will be discussed in Sec- 
tion nvi 



+F 



+F 



+F 



£o = 



FIG. 2: Nonequilibrium three-level model. 



In the low-temperature regime the relative occupa- 
tion ([7]) has the asymptotics \og{p\/pn) = —U/T + 
$ sgn(F) + 0(T), showing that independently of the driv- 
ing force there is no population inversion at zero tem- 
perature. Nevertheless, the system undertakes a tran- 
sition between "insulator" and "conductive" regimes at 
F = ±U as seen from the low-temperature current 
asymptotics, 



J ~ sgn(F) e 21 



- + |sgn(_F) T-X)+ 



if \F\ < U 
^±oo if ±F >U 
(10) 

This can be understood by observing that in the low- 
driving (or insulator) regime, \F\ < the state '0' re- 
mains a well defined ground state in the sense that in 
both channels log(fc^ = /fc^ t ) — > +oo for T — > 0, whereas in 
the high-driving (or conductive) regime F > U the sys- 
tem exhibits a limit cycle behavior, log(k7 /k^) — > +oo 

and log(kf /kf) — > — oo; analogously for — F > U. 

Models with more states can exhibit an even richer be- 
havior as we shortly demonstrate via our second example. 



B. Model II: Driven three-level system 

Now we consider a three-level version of the above 
model, with states '0', '1' and '2' mutually connected 
by single channels. The system is driven out of equilib- 
rium by a force acting along the loop — >• 1 — > 2 — > 
and performing equal work, wo->i ~ = W2^q = F , 

along all those transitions, see Fig. [31 The dynamics are 
defined by the transition rates 



\,i± exp 



Ej - £j± ± F 
2k B T 



(11) 



where i+ (respectively i—) is the succeeding (respectively 
the preceding) state along the oriented loop 0^1^ 
2^0; e.g., 0+ = 1, 0- = 2 etc. The prefactors 



Aji > are symmetric in order to satisfy the 



local detailed balance condition ^ but arbitrary other- 
wise. We only assume that they can be kept constant and 
independent of other parameters like the temperature or 
forces. To be specific, we assume that e 2 > £i > £o = 
and F > 0. 

The present model exhibits a rich collection of differ- 
ent zero-temperature phases which arc summarized in 



4 



Zero-temperature phases 


log(po/pi) 


J 


£2 < 2ei 


F < El 


+OO 





F > ei 


+OO 


+00 


£2 > 2ei 


F < El 


+00 





El < F < e 2 — £1 


— 00 





£2 — £1 < F 


— 00 


+ DO 



TABLE I: Zero-temperature phases of the driven three-level 
model. In all cases log(p 2 /po,i) — > —00 for T — > + . 



Table HI In particular, it demonstrates a population in- 
version between levels '0' and T' in the case £2 > 2e\ 
and F > E\. Later we will see that at the "critical" 
driving F = £1, where the zero-temperature population 
inversion occurs, the model exhibits an anomalous low- 
temperature behavior. 



III. STEADY HEAT CAPACITY 

Now we come to the main topic of this paper, which 
is a gauge-invariant construction of the heat capacity of 
driven systems in their steady states. We present here a 
simplified version of the argument given in Q , which is 
also close to the original derivation for weakly irreversible 
heat conducting systems @]. 

To keep a system in a nonequilibrium steady state, 
work needs to be continuously pumped into it and the 
same amount of energy is then dissipated to the heat 
bath, cf. ([5]). When the temperature of the bath changes, 
the system relaxes to new steady conditions with a gen- 
erally different rate of dissipation. Therefore, a direct 
calorimetric experiment has to separate the work/heat 
required to maintain the nonequilibrium conditions from 
the extra energy needed for the thermodynamic transi- 
tion to another steady state. It has been proven that this 
separation can generally be done in a consistent way 
and one obtains an expression for the excess heat that 
is geometric in the quasistatic limit. The latter means 
that when the temperature changes are made infinitely 
slow, the corresponding excess heat remains finite and 
it only depends on the shape of the trajectory in the 
system-parameter space; i.e., it becomes independent of 
the speed of the temperature changes. Taking these im- 
portant results into account, we can actually skip the full 
derivation and consider just a single elementary step in 
such a quasistatic process, namely the energy changes 
along a small and sudden temperature jump. 

Let the system be initially prepared at the steady state 
corresponding to temperature T — ST which is suddenly 
changed to T at time zero: 



T{t) 




for t < 
for t > 



(12) 



The heat flowing to the bath upon the system's relax- 
ation to the new steady state is obtained by summing 



up the energy quanta exchanged with the bath along all 
transitions. The expected heat up to a time t along the 
relaxation process is 



(13) 



where the sum runs over all transitions occurring along a 
realization cj. The expectation is with respect to the 
stochastic process at temperature T but started from 
the initial distribution p( T_dT ) , which coincides with the 
stationary distribution at temperature T — ST. By the 
Markov property of the dynamics, the heat expectation 
can be written as 



Q(t) 



E 

hi 



q,P(j,T\l,0)pf- ST) dT (14) 



Here P(j, r | i, 0) is the transition probability (or propa- 
gator) with respect to the dynamics at temperature T, 
and 



(15) 



is the expected amount of heat per unit of time provided 
the system is at state i. Comparing with we check 
that q = (q) . Expanding the initial distribution up to the 
linear order in ST and writing the propagator in terms 
of a generator of the Markov process, equation (jT4j) gets 
the form 



Q(t) = qt-ST / '^^(e^dr 



Here 



(Lg)i =E fc «->j(#j 



(16) 



(17) 



i, !, 



is the backward Kolmogorov generator, evaluating the 
expected speed of change of a function g provided the 
system is at state i. Clearly, the first term in (ITI3I) is 
the steady dissipation up to time t, whereas the second 
term is the extra contribution which accounts for the 
thermodynamic process connecting the different steady 
states. Its limiting value 



SQ CX = lim[Q(t)-qt] 

t— too 



(18) 



is the announced excess heat for the case of our elemen- 
tary heat process. It can be written in the form 



SQ C 



dpi 
dT 



-stJ2^ 



where we have introduced the quasipotential 
r+00 

Vi = / [{e TL q) t - q] dr 
Ja 



(19) 



(20) 
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One checks that the integral converges whenever the dy- 
namics has a spectral gap. Note that for discrete pro- 
cesses with a finite number of states this boils down to 
the condition that the model has a unique stationary 
distribution. By definition, the quasipotential is gauge- 
invariant and centralized around zero (V") = 0. 

In analogy with equilibrium thermodynamics, the 
steady heat capacity is naturally defined to quantify the 
amount of heat (excess) as —5Q CX = C ncq 5T, where the 
minus sign comes from our convention that positive heat 
Sows out of the system. In terms of the quasipotential, 
the steady heat capacity equals 

i 

Before turning to explicit calculations on our test exam- 
ples, we first look into general properties of the quasipo- 
tential to better understand in what sense it can be seen 
as a generalized energy function. We also indicate how 
it plays a more general role in the quasistatic energetics. 

A. Properties of the quasipotential 

We start by writing another expression for the quasipo- 
tential. Applying the generator L to both sides of ((20)) 
and using the fact that L [const] = 0, we get the relation 

(LV)i = q - ft (22) 

which specifies V up to a constant, the latter being fixed 
by the condition (V) = 0. In this way, the steady heat 
capacity (|2ip is most conveniently evaluated by solving 
the (in our case algebraic) equation (|2"2"]l with the linear 
operator L given by (|17[) : the stationary quantities pi 
and q can be found from Q and ([5]). 

To first check the consistency with equilibrium ther- 
modynamics, let the heat quanta q\^j be given as in ([!]), 
via energy levels and work functions w\^y Assum- 
ing that the latter derive from a potential, they can be 
transformed out by defining new energy levels ii , cf . (|2"j). 
This system obeys detailed balance with respect to the 
canonical stationary distribution pi oc exp(— ii/T) and 
the steady dissipation vanishes, q = 0. In this case the 
heat function ([f~5"j) reads q~i = J2j b ^i^j (^« — ) ano - * ne 
quasipotential becomes Vi = ii — (e), i.e., it essentially 
coincides with the energy levels up to a (temperature- 
dependent) constant ensuring the proper normalization. 
As a result we recover the familiar expression for the 
equilibrium heat capacity in terms of the temperature- 
energy response: C cq = d(i)/dT. Note that although 
the quasipotential generally depends on both the state i 
and the temperature T, these variables are decoupled in 
equilibrium, in the sense that the differences Vi — Vj are 
temperature- independent and the derivatives dVi / dT no 
longer depend on i. Out of equilibrium the temperature- 
state coupling in the quasipotential V remains nontrivial: 



in particular, the quasipotential differences Vi — Vj still 
depend on temperature. 

As an alternative to the gauge- invariant form (|2Tj) . we 
can choose a specific gauge with some energy levels Ei and 
work functions . Then the quasipotential reads Vi = 

Si - (e) + Vi with (LV)i = q - w i: m = Y,j,b k i-^j w i^j- 
So the heat capacity obtains the form 

_m_/9V\ 

Obviously, in this representation each of the right-hand 
side terms depends on the gauge. Whenever the latter 
can be fixed so that V becomes small enough, making 
the second term in (|23p negligible with respect to the 
first term, we obtain an approximative equality between 
the heat capacity and the temperature-energy response. 
Note, however, that the stationary distribution is in gen- 
eral not Boltzmannian with respect to the energy levels 
£i fixed by the gauge. A basic example where such a 
simplification occurs is the closc-to-equilibrium regime, 
with the gauge being naturally fixed by reference equilib- 
rium dynamics. Other examples are provided by various 
models in either high-temperature or low-temperature 
regimes, even without the restriction to weak nonequi- 
librium; see section HVl 

The last argument also indicates that in specific mod- 
els and regimes, the a priori ambiguous notion of energy 
levels for open systems driven by non-potential forces can 
be given a more precise meaning by using the gauge in- 
variance to fix the gauge in an appropriate manner. We 
briefly touch on this issue in the following section. 



B. General quasistatic processes 

Although the above construction of the excess heat 
was specified for a thermodynamic process in which only 
the temperature changes, it can obviously be general- 
ized to arbitrary quasistatic processes. Here the word 
'quasistatic' refers to slow time-dependent transforma- 
tions under which the system evolution can be seen as 
a sequence of small sudden changes, as above. There is 
sufficient time between these changes for the system to 
relax to new steady conditions. Upon this generalization, 
the heat excess takes the form, cf. (JTHJ) , 

5Q ex = -J2ViS Pi = (6V) (24) 

i 

Within a fixed gauge we have Vi = £i — (e) + V as above, 
yielding the quasistatic energy balance relation 

6(e) = -6Q CX + (Se) + (SV) (25) 

which represents the change of mean energy as the sum of 
the quasistatic excess heat, the quasistatic work of poten- 
tial forces and the quasistatic excess work of remaining 



FIG. 3: The quasipotential gap AV = V\ — Vo compared with 
the gap G = dp log [po/pi]- The model parameters are (7 = 1 
and $ = 3. 



FIG. 4: The temperature dependence of the heat capacity 
for subcritical, critical and supercritical driving. The model 
parameters are {7 = 1 and <J> = 3. 



non-potential forces; the last term being absent in equi- 
librium thermodynamics. 

Again, whenever the quasipotential Vi(T) is such that 
its variables i and T approximatively decouple, then it 
can always be written in the form Vi ~ £j + const(T) with 
some temperature-independent energy levels £,;; then 
const(T) = —(e) and hence V ~ 0. In such a case the en- 
ergy levels can be considered to be well-defined, in spite 
of the presence of (possibly strong) non-potential forces. 
Note however that even in such a case the noncquilib- 
rium nature of the dynamics is still made apparent by 
the nontrivial relation between the energy levels £j and 
the stationary distribution p. 



IV. RESULTS FOR MODEL SYSTEMS 

Now we apply the general considerations of the previ- 
ous section to the two models introduced in section II. 



A. Model I 

First we consider the two-level model with asymmetric 
channels which was introduced in section III A[ In terms 
of the a priori gauge with the energy levels £q = 0, E\ = 
U and the work functions = ±F and = =pF, 

the quasipotential is given as Vi = e, — (e) + Vi, with 
(LV)i — q — uii and w = F(k^ — for), Wi = F(k^ — kf); 
cf. section MI Al In fact, we only need to determine the 
gap in the quasipotential, AV = U + Vi — Vq, where 
the latter difference is obtained from (LV)i — (LV)o = 
Wo — w\. As a result, 



tanhf Mp) tanh(^ 

AV = U + F jr. 

1 - tanhf ^ 



■ tanh(^) 



^) tanh(^) tanh(^) 



(26) 



The steady heat capacity is then obtained from equa- 
tion (j2U)l . which for the two- level model simplifies to 



C' 



PaPi 

rp2 



GAV 



(27) 



with the shorthand G = dp log(po/pi), (3 = 1/T. 

Note first that for F = one gets AV = G = U and we 
obtain a well-known formula for the heat capacity of an 
equilibrium two-state model. Away from equilibrium the 
picture becomes far more complicated since both energy- 
dimensional quantities G and AV are now different and 
generally not related in a simple way. Moreover, they 
can obtain opposite signs for large enough driving forces, 
which then results in negative values of the steady heat 
capacity, see Figs. HHU Next we separately analyze three 
asymptotic regimes. 

High temperatures. For large temperature values the 
quasipotential gap is AV = U - Ftanh($/2) + 0(1/T 2 ), 
which coincides with the asymptotics of G as obtained 
from equation Hence the heat capacity equals 



Cncq — 



[[/-Ftanh(f)] : 
4T2 



(28) 



We see that F* := U / tanh($/2) is a critical value of the 
driving, above which the system exhibits a population 
inversion and also the gap AV changes sign. As a result, 
for any F ^ F* the heat capacity is asymptotically 
strictly positive and decaying as 1/T 2 , i.e., similarly 
as in equilibrium. Note that the asymptotic equality 
AV ~ G remains true even for a driving force F much 
larger than the model parameter U , the original meaning 
of which as an energy gap then becomes meaningless. 
Instead, there is another gauge that becomes natural 
here: by making the transformation ^ with ipo = 
and ipi = — F tanh($/2), we obtain "renormalized" 
energy levels with the gap S\ — io = U — Ftanh($/2), 
which is directly seen in the leading asymptotics 
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Ay ~ G ~ i\ — §q. After this transformation, the 
residual non-potential forces contribute to the heat ca- 
pacity only by correction o(l/T 2 ). In this sense the full 
high-temperature regime away from the critical value F* 
is to be understood as essentially close to equilibrium, 
but with the renormalized energy levels ii and the 
corresponding Boltzmann stationary distribution. From 
this point of view the observed population inversion at 
high temperatures and strong driving is only an artifact 
of describing the model in terms of "unphysical" energy 
levels £j. 

High temperatures — critical. We have seen that the 
value F = F* plays a special role since in this case the 
above gauge transformation leads to degenerate energy 
levels, and therefore the heat capacity becomes zero up 
to order 1/T 2 . More detailed calculations reveal that 
both gaps AV and G are of order 1/T 2 which yields an 
anomalously fast-decaying heat capacity, 




FIG. 5: Steady heat capacity as a function of the driving, 
with the parameters U = 1, $ = 3, and T = 1. The tiny 
region of negative heat capacity in the vicinity of the critical 
driving is zoomed in. 



u 6 



ncq 



64T 6 sinh 4 (|) 



o(l/T 6 



(29) 



The existence of the high-temperature critical driving 
leads to the following subtle phenomenon: there is a tem- 
perature curve T = along which AV = and 
another one, T = T 2 (F) > T X (F), on which G = 0. 
Both curves have the identical leading asymptotics, for 
F > F* 



1 $ 
— — - = 2sinh( — 1 
T 1 - 2 (F) y 2> 



2(F-F*) 
U 3 sinh $ 



+ o((F -F*) 1 ' 2 ) 



(30) 

On both curves the heat capacity vanishes and they form 
the boundary of a tiny region in the (T, F)— space inside 
which C neq exhibits negative values. Its full dependence 
on the driving for a fixed intermediate temperature is 
depicted on Fig. [5] where the above mentioned region has 
been zoomed in. Notice the negative values of the heat 
capacity for large F; this is a strong-noncquilibrium effect 
and we may expect that no gauge transformation would 
significantly simplify the thermodynamic description in 
this region due to a strong temperature-dependence of 
the quasipotential gap AV". 

Low temperatures. The quasipotential gap AV has the 
low-temperature asymptotics 

AV = U+\F\ + 0(\F\ e~ min Wl i? l}/ T ) (31) 

in which the temperature dependence emerges only in 
the exponentially small correction (along the limit T — > 
+ ). This suggests that it is appropriate to make the 
gauge transformation with ipo = and ifix = F, to 
define the "renormalized" energy levels £o = and 
i\ = U + \F\ through which the heat capacity gets 
the simplified approximate form C ncq — d(e) / dT, i.e, 
with only a negligible contribution from the second term 




0.1 0.2 0.3 0.4 0.5 0.6 



FIG. 6: Curves of constant heat capacity in the (T, F)— plane 
for the three-level model. The parameters are si = 1, £2 = 3, 
and A ,i = 1, A ly2 = 2, A 2 ,o = 4. 



in ((23]) . One checks by comparing with the exact re- 
sult that this intuition is indeed correct. The appar- 
ent disagreement between the low-temperature asymp- 
totics of the gaps AV and G, cf. (J7]) and ([3T]) . indi- 
cates that the low-temperature regime corresponds to 
strong nonequilibrium with non-Boltzmannian statistics. 
Formally, it can be described by an effective tempera- 
ture defined by log(pi/po) = — (ei — £o)/T cS , explic- 
itly T cff = T(l + \F\/U) > T. Using the fact that 
C noq ~ (1 + \F\/U)d(i)/dT cS 7 we can trace back the 
exponential decay of the heat capacity for T — >• + to the 
exponential suppression of thermal excitation, which is 
analogous to the equilibrium Third law. 

Since AV ~ U +\F\ > 0, and recalling that our model 
exhibits no population inversion in the zero-temperature 
limit, we conclude that the steady heat capacity remains 
strictly positive at low temperatures. In particular, it 
does not exhibit any transition at F = U where the 
system undertakes a change between the "insulator" and 
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the "conductive" transport regimes. 

We finish this section by indicating how to extend the 
above approximate description of the low-temperature 
behavior to arbitrary temperatures and driving forces. 
Formally defining the effective temperature T cS = 
AV/\og(po/pi), we can write the heat excess (|24|) in the 
form of a Clausius equality 

- SQ CX = T cfi SS , S = - ]T Pi log Pl (32) 

1=1,2 

with S the Shannon entropy of the stationary distribu- 
tion p. In this framework the heat capacity obtains the 
form C neq = T cfi SS/6T. In contrast with the above 
low-temperature regime, the effective temperature now 
becomes a nontrivial function of T; for example, it be- 
comes zero on the critical line T = T X (F). Obviously, 
such a representation in terms of a (single) effective tem- 
perature has no straightforward extension to models with 
a larger number of states, and significant modifications 
are needed. Some extensions of the Clausius relation 
to nonequilibrium and its limitations have been studied 
in 

B. Model II 

For the three-level model we skip the detailed anal- 
ysis and only concentrate on some new features that 
were not seen in the previous two-level example. There- 
fore we consider the case £2 > 2e\ in which the sys- 
tem exhibits a zero-temperature transition in the sta- 
tionary occupations, cf. section III B I The heat capacity in 
the (T, F)— plane is depicted in Fig. [6] where we see that 
(T = 0, F = £1) is an accumulation point of the curves 
of constant heat capacity. 

In order to better understand the behavior we look 
into the critical case F — e± in more detail, and the 
results are summarized in Fig. [7] At zero temperature 
the states '0' and '1' degenerate into a single energy level, 
both in the sense of stationary occupations, pa = p\ = 
1/2, and in the sense of the quasipotential, Vq = V\. 
Increasing the temperature, the occupation of state '0' 
also increases (in this way behaving like an excited state) , 
whereas the quasipotential satisfies V\ > Vo, meaning 
that the degeneracy gets removed and a positive energy 
gap opens between states '0' (lower) and '1' (higher). 
As a direct consequence of these opposite tendencies the 
steady heat capacity becomes negative at F = £\ and 
low temperatures, with an anomalously fast decay to zero 
for T — > + due to the zero-temperature degeneracy of 
both states. Note that although the presence of state 
'3' is essential for breaking the detailed balance and for 
the nonequilibrium features of our model, it does not 
directly enter low-temperature energetics. It also does 
not substantially contribute to the heat capacity until 
high enough temperatures where its occupation becomes 
relevant. 



V. CONCLUSIONS AND OPEN PROBLEMS 

In this paper we have studied, via simple examples, the 
theoretical proposal that nonequilibrium steady states 
can be assigned a generalized heat capacity character- 
izing the amount of heat absorbed along quasistatic 
changes of the environment temperature. An essential 
point is that here we are concerned with contributions 
to the total dissipated heat which are intrinsically due to 
the (slow) transformations, whereas the dominant contri- 
bution always comes from the omnipresent steady dissi- 
pation. Those "extra costs" needed to (slowly) drive the 
system to a nearby steady state can be measured in terms 
of the excess heat which is by now a well-defined theoreti- 
cal concept. The resulting heat capacity as defined upon 
the excess heat generally differs from the temperature- 
energy response of the system and, in fact, it is inde- 
pendent of the way the system's energy is defined. This 
is particularly important for systems maintained out of 
thermal equilibrium by non-conservative forces for which 
the energy function depends on the gauge chosen. 

As a particular example, we have studied in detail 
the two-level model driven by non-potential forces act- 
ing along two distinct transition channels. It has been 
demonstrated that its steady heat capacity can obtain 
negative values when far from thermal equilibrium. This 
phenomenon was traced back to a large discrepancy be- 
tween two characteristic energy quantities which appear 
in the dynamical problem and which coincide under de- 
tailed balance condition: (1) the spacing between "renor- 
malizcd" energy levels as defined via the quasistatic ex- 
cess heat along relaxation processes started from differ- 
ent states, and (2) an effective energy gap associated with 
the stationary occupation statistics. We have also pro- 
posed that the gauge invariance corresponding to dif- 
ferent choices of both the energy levels and the non- 
potential work functions may sometimes be exploited to 
simplify the quasistatic energetics, in the sense that the 
work of (gauged) non-potential forces is made irrelevant. 
In such a case the heat capacity is approximatively given 
in terms of the temperature-energy response, analogously 
to equilibrium. It was also proposed that the quasistatic 
excess heat for driven two-level systems can be expressed 
via a Clausius-type relation with the usual Shannon en- 
tropy and an appropriate effective temperature. We have 
further discussed properties of a driven three-level model 
in a regime where the system exhibits a population in- 
version between the two lower levels and negative heat 
capacity at arbitrarily low temperatures. 

The most relevant open problem seems to be the ex- 
perimental accessibility of the quasistatic excess heat, in 
particular far from thermal equilibrium where the heat 
capacity has been shown to exhibit qualitatively new fea- 
tures. We leave the analysis of experimentally more rele- 
vant mesoscopic systems to a future work. Some deeper 
theoretical insights into a general thermodynamic role 
for the nonequilibrium quasipotential as well as into its 
relation to the stationary occupations are needed. This 
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FIG. 7: Steady heat capacity of the three-level model for the critical driving force F = ei = 1; the model parameters being 
the same as in Fig. [6] The upper, the middle and the lower parts subsequently display the temperature dependence of the 
stationary occupations, the quasipotential (shifted by the mean energy (e)), and the steady heat capacity. 



problem also appears to fit the recent discussions on the 
status and possible extensions of the Clausius relation 
away from thermal equilibrium [(| Q . 

The present work also suggests that even far from 
equilibrium and possibly beyond the scope of general- 
ized Clausius relations, there still may be another sim- 
plification in some cases due to the existence of a pre- 
ferred gauge in which the energy levels become essen- 
tially temperature-independent. As it was demonstrated 
on the low-temperature regime of our two-level model 
with distinctly non-Boltzmannian statistics (under the 
original temperature), this proposal indeed goes beyond 



usual close-to-equilibrium considerations. It remains to 
be understood better whether such an essential removal 
of non-conservative contributions to the quasistatic en- 
ergetics may lead to useful relations between quantities 
characterizing far-from-cquilibrium steady states. Other 
open questions include the relation of the steady heat ca- 
pacity to nonequilibrium fluctuations, the understanding 
of its low-temperature patterns or derivation of general 
lower bounds on the (possibly negative) heat capacity. 
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